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I.  Statement  of  Problems  Studied 

W-e  have  examined  the  following  problems^ 

i)  i)  Routing  and  optimal  scheduling  in  communication  networks,' 

u)  Optimal  scheduling  of  failure  prone  Qexible  manufacturing  systems.' 

,  t 

lii)  0  Determining  when  zero-inventory  policies  are  optimal^' 

iv)  i.)  Characterizing  worst-case  strategies  in  sequential  decision  problems, 

vij  j  Determining  minimum  variance  control  laws  for  general  multi-variable  ARMAX 
systems, 

Vi)  ^^Determining  the  necessary  and  sufficient  condition  for  simulated  annealing  to  hit 
the  global  minimum  with  probability  oncj  fu-  i 

vii)  ij  Developing  stable  distributed,  real-time  scheduling  algorithms  for  large  flexible 
manuf  act  uring/assembly /disassembly  systems. 


II.  Summary  of  the  Most  Important  Results 

i)  A  central  problem  in  communication  networks  is  that  of  choosing  the  routes  which 
the  individual  packets  must  follow  in  order  to  reach  their  destination  from  the  ori¬ 
gin.  Though  fixed  routes  can  be  established  for  each  origin  -  destination  pair,  such 
policies  are  static  and  their  performance  can  be  improved  by  dynamic  policies 
which  choose  routes  on  the  basis  of  the  existing  traffic  and  network  state.  We  have 
examined  a  particular  case  of  the  dynamic  routing  problem  where  one  has  to  choose 
between  several  parallel  routes,  each  of  pxjssibly  different  speed.  We  have  shown 
that  in  some  cases,  systemwide  optimal  routing  policies  are  also  user  optimal,  and 
that  further,  such  user  optimal  policies  are  insensitive  to  the  probabilistic  nature 
of  the  arriving  traffic.  In  the  particular  case  of  exponentially  distributed  rout 
traversal  times,  the  optimal  policies  are  simply  given  by  certain  trivially  comput¬ 
able  threshold  numbers. 

ii)  A  critical  problem  in  the  scheduling  of  flexible  manufacturing  systems  is  to  take 
optimal  advantage  of  their  flexibility  and  easy  reconfigurability.  We  have  exam¬ 
ined  the  particular  case  of  obtaining  scheduling  policies  which  maintain  the  produc¬ 
tion  rate  at  a  desired  level  inspite  of  inevitable  machine  failures.  We  have  shown 
that  there  exists  an  Optimal  Inventory  Level  and  production  must  be  always 


maintained  so  that  this  Optimal  Inventory  Level  is  reached  as  rapidly  as  possible. 
The  optimal  policies  are  thus  of  bang-bang  type.  Moreover,  the  optimal  inventory 
level  is  trivially  computable. 

iii)  We  have  examined  the  general  problem  of  increasing  the  productivity  of  manufac¬ 
turing  systems.  As  well  known,  inventory  levels  are  a  key  component  of  the  cost 
of  manufacturing.  Recent  developments  in  Japan  dealing  with  the  concept  of  zero- 
inventory  manufacturing  have  attracted  much  attention  in  the  U.S.  This  idea, 
linked  to  such  concepts  as  the  Kan-Ban  system,  and  stockless  production,  are  being 
emulated  bv  manufacturers  in  this  country.  A  fundamental  question  in  this  regard 
is  whether  zero-inventory  policiers  can  ever  be  optimal  for  a  manufacturing  sys¬ 
tem,  or  whether  they  are  implemented  merely  to  enforce  greater  discipline  on  the 
manuf acturing  process. 

We  have  considered  the  problem  of  controlling  the  production  rate  of  a  failure 
prone  manufacturing  system  in  an  optimal  way.  In  the  case  of  an  average  cost  cri¬ 
terion  we  have  determined  conditions  under  which  a  zero  inventory  level  is 
optimal.  This  gives  a  mathematical  basis  and  a  rigorous  proof  of  optimality  of  a 
class  of  policies  known  as  zero  inventory  policies  and  the  concept  of  stockless 
production. 

It  should  be  kept  in  mind  that  zero-inventory  policies  and  stockless  production  are  at 
the  center  of  a  virtual  revolution  in  manufacturing  systems.  Ours  is  a  surprising 
result  which  shows  that  such  zero-inventory  policies  can  actually  be  optimal  even 
in  the  presence  of  uncertainty. 

iv)  We  have  examined  the  problem  of  characterizing  worst  case  strategies  in  sequential 
decision  problems.  The  result  obtained  is  that  these  strategies  can  be  obtained  by 
dynamic  programming  algorithms  even  when  a  saddle  point  does  not  exist. 

v)  We  have  determined  minimum  variance  control  laws  for  general  multivariable 
ARMAX  systems.  This  determination  was  known  earlier  to  be  a  difficult  problem 
when  the  system  has  a  general  delay  structure  or  is  of  nonminimum  phase.  We 
have  overcome  both  difficulties. 

Vi)  A  problem  central  to  a  vast  number  of  applications  in  communication  networks, 
computer  systems,  manufacturing  systems,  operations  research  and  other  fields  is 
the  problem  of  combinatorial  optimization.  Here  one  needs  to  obtain  the  minimum 
of  a  cost  function  over  several  allowed  configurations  of  the  system.  Usual  descent 
algorithms  get  trapped  in  local  minima.  To  overcome  this,  a  new  scheme  called 
simulated  annealing  has  been  introduced.  This  scheme  takes  random  uphill 
moves,  with  the  randomness  described  by  a  parameter  called  temperature,  in  anal¬ 
ogy  with  the  physical  annealing  process  (where  nature  attains  the  lowest  energy 
crystalline  configuration  when  an  object  is  cooled  slowly). 

We  have  studied  the  problem  of  the  critical  rate  of  cooling  needed  to  guarantee  that 
simulated  annealing  will  lead  to  a  global,  as  opposed  to  local  minimum.  The  under¬ 
lying  question  deals  with  the  asymptotic  properties  of  a  time-inhomogeneous  Mar-  ; 
kov  chain  reminiscent  of  the  singularly  perturbed  type,  but  with  small  parameter 
(the  temperature)  converging  to  zero.  We  have  developed  a  new  theory  for  such 
processes,  which  utilizes  a  new  notion  of  balance  of  recurrence  order.  This  / 
theory,  as  a  special  case,  allows  us  to  determine  the  necessary  and  sufficient  condi-  y 
tions  for  simulated  annealing  to  hit  a  global  minimum  with  probability  one.  It  also  in 


allows  us  to  determine  the  rates  of  convergence  involved.  We  believe  that  this  is  a 
very  fundamental  theoretical  breakthrough  for  the  analysis  of  the  general  class  of 
such  time-inhomogeneous  Markov  processes. 

vii)  We  have  obtained  some  significant  results  on  the  problem  of  real-time  scheduling 
of  Flexible  Manuf acturing  Systems. 

Most  of  the  literature  of  the  past  few  decades  has  concentrated  on  formulating 
scheduling  problems  as  mixed  integer  programming  problems.  The  solution  of  these 
problems  is  quite  hopeless  for  reasonably  sized  systems,  since  the  complexity  of  the 
procedures  grows  exponentially  in  the  number  of  machines,  parts  and  time  horizon. 
Hence  these  procedures  could  not  really  be  implemented  in  real-time. 

By  adopting  a  totally  new  approach  we  have  been  able  to  develop  stable,  distri¬ 
buted  real-time  scheduling  algorithms  for  very  general  flexible 
manufacturing/assembly /disassembly  systems  of  arbitrarily  larger  size. 

Our  algorithms  can  handle  various  real  world  complexities  such  as  multiple  part- 
types,  set-up  times,  rerouting  due  to  yield,  and  transportation  delays. 

Our  class  of  scheduling  policies  are  trivial  to  implement  in  real-time  and  ensure 
that  the  cumulative  production  of  each  part  type  trails  the  desired  production  by 
no  more  than  a  constant.  We  also  exhibit  an  upper  bound  on  the  backlog,  as  well  as 
explicit  lower  bounds  on  the  performance  of  any  algorithm.  We  are  very 
enthusiastic  about  this  new  approach  and  believe  that  it  has  enormous  potential. 
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